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PROGRAMMED LEARNING OF A SECOND LANGUAGE 
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The University of Michigan ‘) 

Les processus de I’apprentissage programnui d’une langue ^trang^rc sont 
examines selon les principes du conditionnement operant qui est i la base des 
techniques de la programmation. Les nuithodes utUls(5es dans divers programmes 
afln de conditionner des riJpertoires lormels (imitation, transcription, lecture et 
dict^e) et des r<Spertoires th^matiques (traduction, appellation, interrogation, etc. , .) 
Sont Interprdt^es selon l*<5vidence exp<5rimentale pour les processus de comporte- 
ment impliquds ; discrimination des stimuli et dlff<5renclation des r^ponses. 

Das programmlerte Erlernen einer Fremdsprache wurde in vorllegendem Bel- 
trag Im Rahmen der wirksamsten Korditlonlerung aui der Basis der Programmie- 

rungstechnik untersucht, i i 

Vf. prlift dabel die in einer Vlelzahl von Programmen verwendeten Methoden 
zur Konditionierung formaler Sachgeblete (Nachahmung, Transkriptlon, Lesen 
und Dlktataufhahme)k sowle thematlscher Sachgeblete (Obersetzung, Begrlffsein- 

ordnung, Fragestellung etc.). a o j c i. 

Diese Untersuchung erfolgt Im Hlnblick auf den klaren Einflufi des Sprach- 

labors auf die Verhaltenswelse des Schillers : Unterscheldung von Stlmulanten und 

Dlfferenzlerung der Antworten. 



INTRODUCTION 

The cardinal requirement of programming, ‘’specify the terminal behaviors ”, 
has nowhere had a more salutary effect on educational technology than in the 
area of second-language learning. Although language pedagogy turned to 
linguistic science for these specifications over two decades ago, the later arrival 
of programmed instruction emphasized, and placed a new perspective on, the 
contribution of descriptive linguistics. The new emphasis is that linguistic speci- 
fications are a sitw qua non for the conditioning enterprise; they codify group 
norms for verbal behavior in the relevant language community and, therefore, 
provide the programmer with criteria for acceptable forms and sequences of 
responses. The new perspective is that a linguistic analysis of terminal behaviors 
is not a prescription for second-language learning, this is the task of the pro- 
grammer. 

1) The preparation of this article and certain of the experiments reported herein 
were supported in part by a contract with the Language Development Section, U. S. 
Office of Education. I am Indebeted to F. R. Morton and A. B. Gaarder who in- 
spired and financed, respectively, my Interest in second-language learning, and to 
D. M. Brethower, G. L. Gels, R. Glaser, and S. Sapon for helpful suggestions 

concerning this article. 
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The good fortune of the language programmer (and student) In finding an 
entire discipline devoted to the systematic specification of terminal behaviors is 
overreached by an even greater fortune ; the techniques of the laboratory analysis 
and control of behavior, upon which programming is based, are more literally 
applicable to the conditioning of second-language behavior than to most of the 
other repertoires that programming has confronted. The objectives of most 
programs are restricted to changing the written, verbal behavior of a student in 
response to textual stimuli. The prerequisite motor responses and discrimina- 
tions among orthographic stimuli have already been conditioned and are taken 
for granted, The behaviors involved in reading and understanding English and 
in writing at least a "reasonable” answer are also assumed. As Gilbert (1962) 
has put it: "Our student is not a master of the subject because he cannot make 
the mastery responses on the right occasions, not because he is unable to make 
those responses at all . . . The responses of mastery are there. . . ” (p. II), This type 
of verbal conditioning, involving a restructuring of the student’s highly articulate 
first-language repertoires, has a limited resemblance to laboratory research on 
the control of behavior. Transitional behavior effected by shifting contingencies 
of reinforcement, patterns of discriminative stimuli, or both, is little studied and 
poorly understood In comparison with the shaping, maintenance, and extinction 
of behavior in initially naive organisms. 

The programming task of restructuring an extant verbal repertoire may be 
contrasted to that of conditioning second-language fluency. In the latter case, 
there is nothing extrapolative in the application of laboratory techniques and 
nothing metaphorical in the use of concepts gained from a functional analysis of 
behavior in the laboratory. New discriminations (auditory, textual) must be 
conditioned, new forms of response (vocal, written) must be differentiated, con- 
current responses of differing topography must each be brought under the 
control of appropriate discriminative stimuli, novel chains of topographically 
novel responses must be established, and so forth. These behaviors must be 
conditioned largely de novo, although it is never possible, as we shall see, to over- 
look sources of Interference and enhancement from the first-language reper- 
toires. 

Two other developments augur well for the success of second-language pro- 
gramming. The interest of the communication sciences in verbal, especially 
vocal, behavior has led to a greater sophistication and instrumental capability in 
describing and analyzing the vocal response than is available for any other be- 
havior (Fant, 1958). These disciplines have also contributed significant techni- 
ques and data toward an understanding of the listener’s behavior as well as that 
of the speaker (Licklider and Miller, 1951). Another source of methods and 
findings for the control of verbal behavior is less well developed but bound to 
have equal or greater impact on language pedagogy; this is the rapidly growing 
discipline of psycholinguistics (Saporta, 1961). 
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If second -language pr<-gramming is aided by these four ’’sources of 
strength”, it also has four countervailing antecedents in language pedagogy 
which must be set aside; an unsuitable model of learning, imdue emphasis on 
language aptitude, subjective evaluation of student performance, and incom- 
petent classroom research. 

The language teacher has operated frankly with a sunburn model of learning 
flLane, 1962c) and his techniques are as ineflQcient as this characterization of 
learning is inappropriate. The teacher, prime source of knowledge, light (and, 
occasionally, heat) ’’exposes” students to the language and its principles. He is 
aided in this endeavor by the language laboratory, now a commonplace in 
secondary education (Morton, 1961b), which also exposes the students to the 
material in limited doses ; 20 minutes is generally considered the maximum safe 
exposure in one treatment. When classroom practices permit active participation 
by the student at all, it is usually in the form of repetitive drills which are pre- 
sumed to ’’fix” or ’’stamp in” the material through repetition alone. The 
’’brighter” students ’’soak up” the material and become ’’enlightened.” Dull 
students, who fail to learn, are simply not ’’sensitive” or ’’receptive. 

The remarkable plasticity of behavior is ignored by this model. Instead of 
acknowledging that the inadequacies of the students are the product of nnade- 
quate technique, and then spending all eflfort to improve technique, teachers 
often assign the key role in language learning to ability or endowment, and thus 
place the process beyond their control - and responsibility. The construct 
”langu^lge aptitude” is the dm exmachinaihzt spares the language-learning story 
its tragic ending. In constructing so-called aptitude tests, psychologists have not 
helped to refocus attention on the critical variables, the manipulable variables, in 
language-learning. Indeed, since it is invariably true that the student who takes 
the test is assigned an aptitude score, the presence of the score lends credence to 
the reality of aptitudes. This gambit has as much practical effect as lifting oneself 
by one’s own bootstraps, and leaves the language teacher in about the stance 
implied. The naive assumption that aptitude tests measure innate capacity is no 
longer acceptable. As one noted student of individual differences points out, ”It 
should be obvious that all psychological tests measure the indlvidud’s currerit 
behavior, which inevitably reflects the influence of prior learning (Anastasi, 
1961, p. 425). The task of the language teacher or programmer is to destroy the 
test — retest reliability of language aptitude tests. 

Evaluations of pedagogical techniques in second-language learning are most 
often grossly multi-dimensional, idiosyncratic and subjective. ’’The objectives of 
foreign language study still include such goals as understanding the foreign 
culture, appreciating the great works of literature in the language, increasing 
English vocabulary, learning about grammar - Latin even taught us how to 
think!” (Sapon, 1963). The merit of multiple and complex objectives such as 
these is that the inadequacy of language pedagogy in attaining them cannot be 
assessed; thus, ’’achievement” in these areas may be offered as mitigating the 
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limited efifect of the teacher in conditioning the language behaviors themselves. 
Even when the objectives are somewhat more circumscribed, as '*a spoken 
command of the language,” the criteria for an acceptable response include such 
notions as phonetic accuracy, response latency, intonational accuracy, appro- 
priateness of vocabulary, richness of vocabulary, use of idioms, propriety of 
style, etc. Only rarely has the criterion behavior been adequately specified, and 
even under those circumstances, the assessment device usually involves a panel of 
judges and is heir to the traditional problems of inter- and intra-judge reliability 
and validity. 

Prior research on second-language learning “) has been, with few exceptions, 
seriously inadequate, Carroll (1962) seems to damn it all, in an extensive survey 
of research in this area, by concluding with the faint praise : it is clearly within 

the realm of possibility that the results of such research could make language 
teaching more efiectlve and efficient ”(p. 52). 

The inadequacies of the research are multiple. "Whereas psychologists per- 
form experiments with insufficient relevance to foreign language teaching, 
members of the foreign language teaching profession perform studies with 
insufficient experimental rigor” (Carroll, 1962, p. 9). Even when relevance and 
rigor have prevailed, studies in this area have suffered the many evils of compari- 
son-group designs (vide Lane, 1961). Furthermore, the comparison is usually 

among the effects of complex experimental treatments, many-faceted and extend- 
ing over many months, evaluated all too often either anecdotally or by tests of 
doubtful validily and reliability. These properties of the experimental method are 
in part the result of competing pedagogical and research objectives in the class- 
room setting. As a consequence, the findings of even the most carefully executed 
studies have little generality. No wonder that Carroll (I960) finds no research 
basis for educational policy on foreign language teaching ; "However sympa- 
thetic we may be to [current] recommendations, they are often based on assump- 
tions about which the most charitable thing to say is that they have not been 
proven” (p. 137). 

The character of current second-language programming reflects these several 
antecedents. Many programs draw extensively from the findings of linguistics, 
both in specifying the terminal behaviors and in determining sequencing based 
on a contrastive analysis of ffie student’s first and second languages, A few 
have systematically applied laboratory techniques for the control of behavior. A 
lesser number reveal the impress of findings in the communication sciences, 
especially in acoustic phonetics; psycholinguistics has had little impact as yet. 
Finally, many programming efforts have inherited the tradition of educational 
research in language pedagogy. The program is admixed with arbitrary 
amounts of classroom and language-laboratory instruction and drill and the 
effects of the complex enterprise are compared in cursory fashion with those of 
more traditional methods. The failure to provide a detailed account of the termi- 

2) See Carroll (1963), Nostrand (1962) and Pimsleur (I960). 




PROGRAMMED LEARNING 253 



nal repertoires actually attained by students who have completed the second- 
language program is almost universal, 

The present discussion of the basic research underpinnings and applied 
findings in second-language programming proceeds in terms of a functional 
analysis of verbal behavior (Skinner, 1957). The discussion is hehavioml, because 
the objective of second-language programming is to condition certain terminal 
behaviors (largely spoken and written); the discussion draws heavily on a 
fimctional analysis, because it is this analysis which describes the relations between 
the antecedents and consequences of behavior and the behavior itself; we must 
know these controlling relations if we are to arrange effective and efficient 
second-language learning. 

A functional analysis of the terminal behaviors for a second-language pro- 
gram will usefully distinguish between formal repertoires, in which there is a 
point-to-point correspondence between stimulus and response, and thematic 
repertoires in which responses are controlled by common sets of variables but 
without formal correspondences (Skinner, I960). The student (or child) who 
has learned only to imitate, read, and copy In a new language has acquired purely 
formal repertoires ; the topography of his behavior in each case shows a point- 
to-point correspondence to the form of the stimulus conditions. However, he is 
as yet unable to respond appropriately to the nature of the stimulus conditions 
and this lack of thematic repertoires leaves him unprepared to join the verbal 
community, fn sum, he knows how to say things but he does not know what to 
say. Talking birds, mimics, typists, and stenographers may earn their keep by 
purelv formal repertoires, but most adult verbal behavior reflects both formal 
and thematic sources of strength. Thus, the terminal behavior of the student will 
be determined both phonetically (or ortho graphically) by the audience and 
thematically by the environmental conditions. 

The distinction between the two repertoires may be sharpened by noting that 
a minimal unit of behavior may be identified for a purely formal repertoire and 
formal repertoires may therefore be extended readily to new stimuli. The 
minimal unit may be the phoneme or the grapheme or it may be even more 
fragmentary. Once these stimulus-response units are made available through the 
conditioning of a formal repertoire, the student can respond adequately to novel 
stimuli by responding piecemeal — that is, with a series of unit responses never 
before arranged in that order. For example, minimal command of the formal 
repertoire involved in reading English text permits a passable attempt at, say, 
“marmoset,** but nothing in the thematic repertoires that the student may have 
acquired previously enables him to say “marmoset ’’ in the presence of mar- 
mosets^ to make statements about marmosets, and so forth. The ability pf formal 
repertoires to be extended to new stimuli is predicated on the availability of 
minimal units which require, in turn, the point-to-point correspondence of 
stimulus and response that characterizes these repertoires. 
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FORMAL REPERTOIRES 

We may subdivide the formal repertoires involved in second-language learn- 
ing according to whether the stimulus and the response are each written or 
spoken. The distinction is important not only because the two classes of stimuli 
have different modalities and the two classes of responses have different topo- 
graphies, but also because the four possible fxmctional relations have different 
dynamic properties. When both stimulus and response are spoken, we term the 
behavior echoic; the name implies the point-to-point acoustic correspondence 
which characterizes this repertoire. In transcription, both stimulus and response 
are written. In textual behavior, a spoken response is controlled by a written 
stimulus. In dictation, the stimulus is spoken, the response written. In each of the 
first two formal classes, the stimulus and the response have similar form, acous- 
tic or visual, but in all four classes it is possible to predict the response given the 
stim w^us or to infer the nature of the stimulus if the response is known ; this is 
another way of stating the point-to-point correspondence between stimulus and 
response that defines a formal repertoire. 

Each of the four formal repertoires obviously requires that the student make 
different responses to physically different stimuli ; it is perhaps less obvious that 
he must more often make the same response to different stimuli ; different fonts 
of type typically evoke the same textual behavior, differing rates of speaking the 
same transcriptions, and so forth. When the properties of responding change 
following a change in the stimulus, we speak of stimulus discrimination ; to the 
degree that responding remains invariant xmder this change, we speak of stimu- 
lus generalization. The first requirement of a formal repertoire, then, concerns 
stimulus control : there must be generalization within arbitrarily defined classes 
of stimuli and discriminations between these classes. The second requirement 
concerns the properties of responding : response topography must show small, 
systematic varia turn within arbitrarily defined classes and large and abrupt 
changes from one class to the next. The third requirement of a formd repertoire 
concerns the Coordination of changes in the stimulus with changes in the re- 
sponse. To take an example from a textual repertoire in English, in order to 
read the pair of words "pin pan,” these requirements must be met : (l) the 
- orthographic symbol "i” must be visually discriminated from "a,” etc., but 
generalized with 'V,” "I,” and that letter in various type fonts ; similar require- 
ments apply to "a” and to the other letters. (2) response topography must in- 
clude distinct response classes such as [ph], [ 1 ], and [ae] but there is also a range 
of permissible and necessary variation within each class; thus, the reading of 
"pin” may range from [phm] to [pbi;n] or to [pm]. (3)[pb] must oc:ur in the 
presence of initial ”p,” [ i ] in the presence of ”i,” and so forth. Even if the letters 
"i” and "a” discriminated and the responses [ij and [ae] are dijferenttated, 
without the coordination required the textual behavior would be incorrect (c.g., 
[phaen — phin]). 



mmmt 
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Before considering e&ch of the four fornia.1 repertories, the sections that 
follow describe some recent experiments on discrimination, differentiation, and 
coordination. Laboratory research on these behavioral processes provides 
methods and findings that may be used to arrange their acquisition in second- 
language programming. 

Discrimination learning and transfer 

The acquisition and maintenance of stimulus discriminations have been stud- 
ied extensively with human and infra-human organisms in the psychological 
laboratory. These experiments involve most often stimuli that are synthesized in 
the laboratory and varied along a single dimension, such as pure tone frequency. 
Controlled experiments on discrimination learning with synthetic stimuli vary- 
ing in serveral dimensions, or with stimuli from ''natural language” (spoken 
or written), are rare. A description of four representative experiments will 
illustrate methods and findings that are relevant to the programming of second- 
language discriminations involved in the formal repertoires. 

In a series of experiments on discrimination learning with speech stimuli in 
a second language. Lane (1964 b) has observed extremely rapid acquisition of 
differential stimulus control, suggesting the transfer of the subject’s first- 
language discriminations. When a Spanish phoneme was presented as (a 
stimulus correlated with reinforcement for responding) and a variety of English 
approximations were presented as S-^s (correlated with nonreinforcement), the 
subjects stopped responding to S^s after the first few presentations,’’' Indeed, 
most of the errors in learning were due to ''over-discriminating,” that is, failing 
to repsond to the allophonic variants of throughout the sequence of stimuli. 
In one study, a self-instruction program was prepared to teach discriminations 
among the vowels and consonants of Spanish. The program was subdivided into 
14 frames, each of which included allophones of a particular Spanish phoneme 
(S^) and those of other English and Spanish phonemes (S^’s). The 14 frames 
as well as the 60 stimuli within each frame were sequenced according to a tenta- 
tive schedule of difiiculty for the English-speaking student. When the Subject 
responded (button-press) to an S^ or failed to respond to an during the 
4-se,c interstimulus interval, a point was added to a counter in front of him. 
Failing to respond to S^, or a response to an S“^, cost him a point. Figure 1 
shows that most of the frames in this program were mastered to a criterion of 
eight or less errors in a single trial. These data and others reported suggest that 
discrimination learning among the sounds of a second-language, at least one 
within the same family as the subject’s native language, may be expected to pro- 

* [Editor’s] note For a slightly expanted discussion of the role of SD and 
in operant conditioning, the reader is referred to Professor J. B. Carroll’s "Primer 
of programmed instruction in foreign language teaching” in IRAL 1963, 1, p.l24. 
Gf. also A. P. van Teslaar. ''Les domaines de la linguistique a:ppliquee, - II”, IRAL, 
1963, 3’-4, p. 234 ffi. for further references to conditioning theory. 
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F/gufv 1. Discriminatton learning of Spanish phonemes with an audio-lingual pro- 
gram. I'he average number of frames in which three subjects reached criterion 
within one through 17 trials. (From Lane, 1964b.) 










ceed quite rapidly when conditions are optimized because the subject transfers 
first-language discriminations to the new task. Additional support for this 
conclusion was obtained when the program described above was administered 
without reinforcement both before and after programmed learning. For each of 
the 14 frames, Fig. 2 shows the number of errors made during progtammed 
learning plotted against the percent increase in correct responses from the pre- 
test to the post-test. There are some frames for which the increase in the percent 
of correct responses on the tests is small and so is the niunber of errors during 
programmed learning. These frames, represented by points at the lower left of 
Fig. 2, evidenced a high baseline of discrimination which is presumably the 
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INCREASE IN PERCENT CORRECT 
FROM PRE-TEST TO POST-TEST 

Ffgun2. Discrimination learning with an audio - lingual program. For each of 
14 frames, the number of errors made during discrimination training is plotted 
against the percent Increase in correct responses from a pre-test to a post-test, in 
which the program was administered without reinforcement. (From Lane, 1964b.) 



largesse of first-language learning. For further evidence of the transfer of first- 
language discriminations, consider the frames, represented by points toward the 
lower right of the figure, for which there was a large increase in percent correct 
on the tests following a period of learning with relatively few errors. Figure 3 
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permits a closer look at the time-course of discrimination learning during one 
of these frames (the one showing a 47 percent increase in accurracy). This graph 
of cumulative correct responses to successive stimuli shows that the subject 
responded to the first (as instructed), then failed to respond to the next two 
presentations of S^, and responded correctly thereafter. The abrupt increase to 
near-perfect performance after but a few errors represents the transfer rather than 
the acquisition of a discrimination; it has been called "concept attainment" in 
other quarters. 

The transfer of first-language discriminations, reflected by the function in 
Fig. 3, may be contrasted with the more rare case of genuine acquisition of a 




Bigtm 3. Transfer of discrimination in an audio-lingual program. Cumulative 
correct responses to consecutive stimuli by one subject. (From Lane, 1964 b.) 
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Speech discrimination, shown by the cumulaUve curve in Fig, 4, obtained from 
the same subject. This graph corresponds to the iilled circle toward the top of 
Fig, 2 ; the numerous errors during discrimination learning are evident but they 
were not in vain, for the subject’s post-test revealed a 15 percent increase in 
accurracy. In this frame, which involved the trilled Spanish /r/ in Intervocalic 
position as and the English /r/ in that position as we sec the more gradual 

development of diflfcrentlal stimulus control that is normally associated with the 
process of discrimination learning. 
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Figure 4. Acquisition of discrimination in an audio-lingual program, Cumulative 
correct responses to consecutive stimuli by one subject during 12 trials, ^rom Lane, 
1964 b.) 



Suppes et al. (1962) have performed several studies of discrimination among 
Russian phonemes and have examined the fit of mathematical models to the 
observed time-course of discrimination learning. In one study, a basic list of 
Russian syllables was constructed with 32 initial consonant phonemes and 5 
vowels. The 144 syllables were grouped into contrasting pairs, differing only in 
the initial consonant. Twenty-six consonant-vowel (CV) contrasts were selected 
and each was presented in four permutations : CiVi : C 2 V 2 ; C 2 V 1 : CiVi ; 
Cl Vi : CiVi ; and C 2 V 2 : C 2 V 2 . The list of 104 contrast pairs was recorded in 
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random order by a linguist and presented for one-half hour daily, on five days, to 
individual subjects for judgments of same or different. Incorrect responses were 
followed by a flash of light. A contrastive analysis of English and Russian and 
some pilot studies suggested that certain contrast pairs would prove easier to 
discriminate than others ; these were presented to one group of twenty subjects 
while those considered difficult were presented to another group of twenty. 

The first group showed a drop in errors over the five days from 1 1 to 2 per 
cent, the second from 22 to 10 percent. The low initial error rates (high base- 
lines of discrimination) probably reflect transfer of first-language discrimina- 
tions, discussed above. Based on the error distributions obtained in this experi- 
ment, the authofs present a rank ordering of the Russian consonants and vowels 
with respect to difficulty in discrimination learning foi: English-speaking sub- 
jects ; the order accords well with that predicted from a contrastive analysis of the 
two languages. 

In a subsequent study, Suppes, Crothers, and Weir (1962) examined dis- 
crimination learning among Russian vowel phonemes and the effect of se- 
quencing stimulus presentations according to expected difficulty. The subject 
was presented with a recorded series of sets of five stimuli during six daily 15- 
minute sessions distributed over a period of 11 days. Each stimulus was a 
Russian word containing one vowel preceeded and/or followed by a consonant. 
The subject was instructed to select the alternate stimulus in each set which 
contained the same vowel as the first stimulus in the set; he was then told the 
correct answer. One group of subjects (N = 44) received a fixed series of items 
in random order (R), a second (N = 54) received progressively longer and more 
difficult items in each daily session (P). 

Figure 5 shows the proportion of errors on each experimental day for the 
subjects in each group. On day 1, the programmed subgroups naturally show 
fewer errors since they were presented with only the easier discriminations in 
the fixed series presented to group R. On days 5 and 6, when both groups were 
presented the same discrimination series, the programmed group committed a 
reliably greater number of errors. In interpreting this finding it must be remem- 
bered that the programmed group had less training on certain of the difficult 
discriminations because of the sequencing of stimuli presented to them. The 
procedure of vowel-phoneme matching from a set of alternatives permits the 
preparation of a confusion matrix which can serve as a guide to sequencing and 
repetition in programming the acquisition of the relevant discriminations (cf. 
Sapon and Carroll, 1958, and discussion below). ' 

These three studies and others (Hmsleur, 1963; Lane &Moore, 1962; Lane, 
1962a) illustrate the extensive transfei: of first-language discriminations in 
second-language learning, whether the task be identification, detection of a 
difference, or recognition, respectively (see Gallanter, 1962). The second experi- 
ment by Suppes et al. and that by Swets et al. to be described show, however, that 
rapid and relativdy error-free discrimination learning cannot be assured solely 



PROGRAMMED LEARNING 261 




on the basis of an a priori sequencing of item difficulty. Among other 
ments, there must be an iterative process of program revision, including the 
revision, addition and deletion of frames and sequences, based on an analysis ot 

student errors. . 

Swets and co-workers (1962) applied computer-based programmed instruc- 
tion to examine the usefulness of overt response, immediate reinforcement, 
adaptive sequencing, and self-pacing in learning to identify multidimensional 
sounds. They found that these procedures "produced results that are compar- 
able to those obtained previously with conventional training meffiods, Certam 

of the central features of automated instruction were found to hinder learning m 
the task studied” (p. 928 ). A description of oneoftheir series of four experiments 
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will illustrate method and results. While seated in front of a typewriter connected to 
a computer, the subject was presented with one of a set of 32 stimuli over a pair 
of earphones. Each sound assumed one of two possible values along five dimen- 
sions: frequency, amplitude, interruption rate, duty cycle, and duration. Figure6 
shows the percent correct attained on an identification test after a one-hour 
training session with one of five procedures. In condition 1, at the subject’s 
command the computer typed a five digit number that specified the stimulus and 
then played the sound ; the subject did not emit an overt identification response 
but proceeded to give the next command. In condition 2, the subject initiated the 
presentation of the stimulus, then typed the five digit number he believed to 
identify the sound; the computer typed OK or WRONG and, if wrong, typed 
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Figfite 6. Learning to identify multidimensional nonverbal sounds with a computer- 
based program. The effects of two types of response, two types of feedback, condi- 
tional and unconditional selection of successive items, and three levels of reinforce- 
ment probability, on percentage of correct identification. (From Swets ^^^/.^ 1962.) 
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the correct answer. Condition 3 was like condition 2 except that, after an 
erroneous response, the subject received the sound again and made a second 
attempt at correct Identification. Condition 4 was like 3 except that, if the subject 
gave an incorrect answer, he heard the sound corresponding to it, as well as a 
repetition of the test sound before he made a second try. In condition 5, the 
number of trials under the condition 1 procedure was reduced by half so that an 
equal number of trials was received under all procedures. As a consequence ot 
these procedures the probability of response confirmation varied from 0 under 
condition 1 to maximal under condition 4. The authors conclude : 

"The data provide no support for the hypothesis that continual Interroga- 
tion and overt responses are beneficial to learning; [they] show that a fairly 
extensive feedback may be detrimental ... and provide no support for the 
hypothesis that efficiency of learning varies directly with the probability of 
reinforcement” (p. 929)- 

The authors’ conclusions must be generalized with caution. Negative findmgs 
in an evaluation of programmed Instruction may be attributed to many sources. 
In second-language learning, these include faulty analysis of the terminal be- 
haviors, false assumptions about the relevance of the experimental tasks to 
language behavior, and failure to revise the program iteratively, based on an 
analysis of student errors. Negative findings can be interpreted properly only 
when they are based on a program that has been shown, imder other controlled 

conditions, to be effective. 

The use of auditory stimuli which are synthesized electronically, as in the 
preceding experiment, rather than speech stimuli uttered by an informant, often 
provides findings that are more systematic, sensitive, and stable ~ but at a loss in 
Immediate relevance to the applied problem of second-language learning. Recent 
advances in speech , synthesis (Cooper, Liberman and Borst, 1951; Lawrence, 
1953 ; Fant, 1958) make it increasingly possible to perform comparably well- 
controlled experiments In programmed learning with speech stimuli , regret- 
tably, these devices have not found application in this area as yet. 

Stimulus Generalization j. j 

Stimulus generalization, that is, the degree of invariance in responding under 
changes In stimulus conditions, has received extensive study in the laboratory 

with both non-speech and speech stimuli, *) 

An experiment by Cross and Lane (1962), employing stimuli varying along 
a single dimension (intensity of a 500-cps tone), is of particular interest because 
two incompatible responses were conditioned to two disparate stimuli and then 
the probability of emission of each response to Intermediate stimulus intensities 
was determined. This paradigm for discrimination learning and generalization 
testing bears some resemblance to the language-learning situation In which 

®) For example, see the review by Mednick and Freedman (I960) and studies 
reported in Mostofsky (1963). 
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responses from the student’s first- and second-language repertoires compete for 
emission. Figure 7 shows that response probability is maximal and latenty 
minimal when the stimulus associated with reinforcement (S^i or 8^2) is present- 
ed. When the probabilities of emission of the responses are equal, at a median 
stimulus loudness, the latency of responding is greatest. Curiously enough, the 
same findings were obtained when two compatible responses were employed 




(db re: .0002 dynes/cm2 ) 

Figure 7. Generalization gradients for pure tone intensity. The conditional prob- 
abilities were estimated from the total number of/ ka/ responses (Ri) and /ti/ re- 
sponses (R2) emitted in ten presentations of each stimulus intensity to each of 
20 subjects. The total latency (hexagons) at each intensity is the unweighted, mean 
of the average latency of responding by each of 20 subjects. (From Cross and Lane, 
1962 .) 
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(low-pitch vowel and high-pitch vowel); when response probabilities were equal, 
latency was maximal and there was no evidence of response "blending, i-e., 

intermediate pitch, under these conditions* , . j. • i 

This eJfperimental paradigm has recently been extended to multidimensional 
synthetic stimuli with essentially the same results (Cross, 1?63). It turns out that, 
if a discriminative response is conditioned to a stimulus with the properties 
(at bi), the degree of generalization to another stimulus, differing along boto 
dimensions, (aj, b j), is equal to the degree of generalization due to the change in 
a (at — a-), plus Ae degree of generalization due to the change in h, (b) bi). 

It would be interesting to explore generalization in the two-dimensional stimu- 
lus array defined by the first- and second-formant frequencies of synthetic vowels. 
Departures from this simple additive rule of generalization might occur in the 
region of points which define vowels in the subject s native language. 

Over the past two decades, investigators at the Haskins Laboratories have 
greatly enhanced our understanding of the perception of speech by measuring 
the stimulus generalization of listeners responding to synthetic speech stimuli. 
lUustrative of a segment of this research is a study by Liberman et al. (1961 a) ot 
the perception of the voiced stops /d/ and /t/. Spectrographic patterns were 
prepared and converted to sound by means of a device called Pattern Playback. 
W patterns were identical except for the relative onset times of their first and 
second formants: the first formant was cut back in 10-msec steps from 0 to 
60 msec. They were presented in random order to subjects with instructions^ o 
label each stimulus as either /do/ or /to/. Cross and Lane (1962) replica ed 
this study with six subjects, and also measured response latency; their findings 

♦ [Editor’s note] The term "latency” refers to the delay between the presen- 
tation of a stimulus and the appearance of a response. It is one of the basic meas- 
ures used to specify a conditioned or instrumental response. ^ ^ 

"Generalization gradients" here refer to the regular change m the conditional 

. probabUitles. or likelihood, of one or the other response « the Bst stmi^us takes 

on various intensity values intermediate to the intensity levels of the two stimul. that 

the experimental subjects had been trained to discriminate between. 

»f Editor’s note] When subjected to frenquency analysis, all vowels show form- 
ant bands, or points of resonance. The first and second formants corrffiprad to 
the tesonmt feequencies of the two chambers into which the tongue dmdes the 
resonance tube cavity defined at one and by the pharynx, at the o&er by theTjpe- 
With a few exceptions, these arst two formant frequencies suffice '» k 

particular vowel, ffiat is, to distinguish it from the other vowd phoneme «« 
language. Professor Lane proposes an experiment using artffiaal vowds created by 
systematlcdly varying the Brst and second-formant frequencies; and he sugges 
that as the two frequencies approached those vdties characterizing « °f*e 

subject’s native language, there might be a dis^tinulty m the bfe Re- 

sponse; he might distinguish the stimulus with these values fr””, f 
which are non-lingulstic, more ofren than he distinguishes among the non-ling 

tic stimuli themselves. 
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are shown in Fig. 8. Since the /do/ and /to/ response-gradients are complemen- 
tary, only the former is presented. The reader may wish to compare these data 
with those in Fig. 7 ; both experiments measure stimulus generalization after 
two incompatible responses have been conditioned to two discriminative stimuli. 
In studies of generalization among first-language speech stimuli, prior dis- 
crimination training has been arranged, of course, by the verbal community and 
is not controlled by the experimenter. 

The average generalization gradient in Fig. 8 is more shallow than that for 
individual subjects. A very steep phoneme labelling gradient (in the extreme case, 
a step function) means that the subject responds alike (generalizes) to all stimuli 
within a phoneme class and discriminates completely between stimuli drawn 
from the separate classes.* In other words, discrimination training has efiectively 
partitioned the stimulus continuum into two discrete classes of stimuli: /do/- 




ten presentations of each stimulus to each of six sub jetcts. The functions labelled 
(a), (b) and (c) were obtained under Instructions to label the stimuli as /do/— /to/, 
/to / — /do /, and / ka / — /ti / respectively. (From Cross and Lane, 1 962.) 



♦[Editor’s note] A step function means a curve with a 90 slope, in the present 
case one that at one point on the scale plunges from a very high response prob- 
ability to a very low one. 
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stimuli and /to/-stimuli; that is, into two phoneme categories. Support for this 
conclusion comes from further experiments by Liberman and his co-workei:s 
with a number of phonemic contrasts. They find that a subject has great difficulty 
in distinguishing (in a psychophysical task) between those stimuli which he 
labels alike, i.e., those drawn from the same phoneme category, while he readily 
discriminates stimuli drawn from different phoneme categories. Particularly 
noteworthy is their finding that discriminability of the two phonemes is pre- 
dictable from the labelling gradients. The analogous finding for a non-speech 
continuum such as pitch would be that the listener discriminates only as many 
pitches as he can name. This conclusion is in error by a factor of about 200 (the 
number of DL’s for frequency at moderate intensity divided by the magic 

number 7).* * _ , 

Liberman (1957) argues that, in the case of speech stimuli, the phySiCal 

continuum is broken into two discrete perceptual classes because two disc^te 
responses mediate between the stimulus presentations and the recognition 
(labelling) or discrimination (same-different) responses. Thus, for the acoustic 
continuum in Fig. 8, stimuli differing in the delay of first-formant onset evoke 
covertly either the /do/ response or the /to/ response ; these discretely different 
covert responses (voiced -voiceless) - or their neural correlates - then control 
the overt discriminations by the subject. This account of speech discrimination 
in terms of response differentiation, called the motor theory of speech percep- 
tion (Lisker, Cooper, and Liberman, 1962), has important implications for 
selecting a procedure by which these two components of formal repertories 

shall be conditioned and coordinated (see below).* 



♦[Editor’s note] DL’s are difference limens and stand for the just noticeable 
differences that can be detected in a sensory continuum. Within a frequency range 
of 31 to 1 1,700 cycles, about 1400 tones can on an average be distinguished on the 
basis of relative judgment (same-different). However, if an average untrained sub- 
ject is called upon to make an absolute id^itification of different tones, in other 
words to label or name different tones (A, B, C, etc.), it makes little difference how 
many different tones are presented to hiim for identification *. he will class them into 
about seven pigeonholes and make his identification on the basis of these cate- 
gories, which he freely rearranges "... along the pitch continuum to accommodate 

almost any distribution of stimuli’’ (F. Attneave. Applications of Information Theory to 
Psychology. NY 1959 p. 69). Gf. also G. A. Miller. "The magical number seven plus 
or minus two: some limits on our capacity for processing information’’. 

Rev. 1956, 63, 81—97. 

* [Editor ’s note] A mediate response is one, not necessarily available for inspec- 
tion that intervenes upon a given stimulus and itself serves as the stimulus for the 
observed response. In the present discussion, the mediate response is a covert 
neural or neuro-^muscular response associated with the articulation of the syllable 
[do] or [to]. The labelling or discriitninatioft response is made not to the original 
stimulus, but to the covert one. 
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The experiments in stimulus generalization described above sampled the 
formal repertoire called dictation since non-vocal responses were under the 
control of an array of auditory stimuli. Since only two responses were employed 
in each of the studies, an extensive, differentiated repertoire of responses was not 
required. A number of experiments on generalization among speech stimuli 
that differ along several dimensions have capitalized on the extensive repertoire 
ofvocal and written responses that is the largesse of first-language learning. With 
this technique, a Confusion matrix* may be obtained: the discrete stimuli are 
the column headings, the discrete responses the row headings, and the frequency 
of occurrence of Ri over the « presentations of Si gives the entry in the i cell. 

Thus, a confusion matrix is a set of generalization gradients where, typically, the 

independent and dependent variables are nominally scaled {}>ide Stevens, 1951). 

A study by Sapon and Carroll (1958), who determined confusion matrices 
for selected words from English, French, Spanish, Portugese, Italian, and 



* [ Editor ’s note] A confusion matrix is a tabular arrangement of experimental 
matching or identification data that facilitates the systematic confrontation and 
analysis of a large number of variables. 

If w<* im agine an experiment where 100 subjects are called upon tp identify a set 
of four phonemes, /f/ /v/ /e//8/ , certain of which, for example, were absent from 
the subjects 'native language, the outome might take the form of the following 

matrix (the figures are quite imaginary): 

STIMULUS 





;/f/ 


/v/ 




/8/ 


Jfl 


55 


15 


18 


3 




20 


60 


10 


12 


w 


20 


10 


52 


23 


Hi 




15 , 


20 


62 



Sample confusion matrix , N ^ 100 



This simple matrix assembles a considerable amount of data. If the experiment 
included additional phonemes such as /s//// /W and/?/ , then the task of organ- 
izing and using the resultant data would be quite formidable without the help of 
such a matrix.' 

♦ [Editor’s note] '' The Ji‘«/<? i^epresents the most unrestricted assigriment 

of numerals. The numerals are used only as labels or type numbers, and words or 
letters would serve as well.” (Stevens, /or. 
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Russian, illustrates this type of experiment. The procedure was similar to that 
later employed by Suppes, Crothers, and Weir (1962), described above. Ja- 
panese, American, and Latin-American listeners with virtually no second-lan- 
guage training were employed. The pattern of errors in phoneme matching was 
found to be nonrandom; significant differences among the three language 
groups of listeners were obtained. To cite one example, stop consonants were 
always matched with other stop consonants by Latin-American listeners, while 
American and Japanese subjects often chose fricatives. In the light of these 
findings, the authors properly warn against interpreting confusion data ob- 
tained with one language group as generally characteristic of human sensory 
processes or stimulus generalization. 

As indicated earlier, these confusion matrices provide a valuable guide to the 
second-language programmer and an empirical check on the order of dis- 
crimination diffiedty based on contrastive analysis. Relff (1961) has suggested 
that this analysis would Ideally contrast each student’s idiolect with that of the 
target language. Short of this extreme, he mentions that the Linguistic Atlas of 
the United States may serve as a guide when the student S residence Is known. 
For example, *‘a native of Eastern Pennsylvania will need a heavier preponderance 
of the discrimination [o'] [aV] - or [ew] - than between [d] and [o'w]” (p. 91). It 
does not seem Implausible that programs to condition second-language echoic 
behavior which are developed In different regions of the United States may differ 
In their emphasis on certain discriminations. 

Response differentiation 

The differentiation of spoken or written responding, which Is the second 
requirement of a formal repertoire. Is predicated on the inherent variability of all 
behavior. In the laboratory, the technique of shaping or response differentatlon 
amounts to this: "We select one (or more) of the ‘natural* variations of a well- 
conditioned response and give it exdnsive reinforcement; the remaining variations 
are subjected to extinction. If we pickout. In advance, a variation that has been of 
fairly frequent occurrence, and if we apply this selective reinforcement rigorously, 
we can soon produce an Increase In the frequency of the response that possesses 
the properly or properties that we have chosen” (Keller and Schoenfeld, 1950, 

p. 186). 

Differential reinforcement of vocal responding has rarely been studied in the 
laboratory; this Is particularly regrettable In view of Its importance in the 
acquisition of second-language fluency and the relative ease with which the to- 
pography of this behavior may be measured ipide Lane and Shinkman, 1963). 
A study of shaping vocal duration, reported by Lane (1964 a), illustrates the 
methpd and findings In this application, The subject Is seated in an audiometric 
room In front of a microphone, light, and coin dispenser. He is told to say /u/ 
uhep the light flashes and that the only pay he will receive will be dispensed In 
front of him, contingent on appropriate behavior. Each of the first 20 responses 
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receives reinforcement (1 cent) and its duration is noted. A subclass of this 
operant is then chosen for selective reinforcement. In the experiment whose 
findings are shown in Fig. J) the mean (M) and average deviation (AD) of the set 
of 20 responses was computed and, in the second phase of the experiment, all 
responses whose duration exceeded Mi + ADj were reinforced. The phase was 
continued until 10 successive reinforcements were received. Then, M 2 "f-AD 2 
was computed for these 10 responses, and this value set as criterion for phase 3. 
In this &shion, the vocal duration of the subject was shaped (filled triangles) 
from approximately one-fifth of a second to nearly one-half second. After the fifth 
phase, the experimenter reversed the direction of shaping, now reinforcing all 
responses with duration less than Mj -- ADj. The experiment was terminated 
when the subject’s vocal duration was reduced to one-tenth second. This subject. 




9. Differential reinforcement of vocal duration with one subject; shaping 
longer and then shorter durations. The relation between criterion response dura- 
tion for differential reinforcement and the mean duration of unreinforced responses 
(inverted triangles), non-terminal reinforced responses (open triangles) and the ten 
terminal reinforced responses (filled triangles) in each phase. (The pluses indicate 
the reinforcement criterion for each successive phase during the shaping of longer 
durations; the minuses indicatethe criteria during the shaping of shorter durations.) 
(From Lane, 1964 a.) 
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like most of the others whose behavior was similarly manipulated, was unable to 
report the property of his behavior that produced the mon^r ( unable in the 
sense that extensive prompting by a carefully-worded questionnaire, presented 
after the experiment, failed to yield an accurate report, if any at all). 

Other experiments in this series varied the ’'size of step" that the subject had 
to take from one phase to the next; that is, the difference between the mean dura- 
tion of ongoing responding and the new criterion, (C— M), was varied. A signifi- 
cant generalization arose from the data for over 30 subjects and a wide variety of 
step sizes. It was not possible to predict, from the size of step alone, either the 
success of the shaping process, that is, whether the subject would reach criterion, 
or the amount of shaping necessary before criterion was reached. However, it 
was possible to predict the length and outcome of the shaping process when the 
step size (C— M) was expressed in terms of the variability ((J) of ongoing be- 

havlor. The statistic called the shaping Index, was correlated 0.4 with the 

number of responses that were emitted before criterion was reached, and it was 
found to be large whenever the shaping process failed. 

When the shaping index is large, either because the step size Is large, the 
variability small, or both, the a probability of a reinforced response Is low 
and the success of the shaping process Is endangered. When the shaping Index 
Is small, the probability of a reinforced response Is high and the success of 
shaping Is secured ; however, this may require many small steps to lead from the 
student’s Initial repertoire to the desired terminal repertoire. Therefore, the 
security of the shaping process and Its efiSciency are maximized when the prob- 
ability of a reinforced response Is set at some value, as yet unexplored, between 
zero and one, through a suitable choice of step size. It may not be too great an 
extrapolation of the Initial findings of this research to suggest that the widely- 
discussed Issue of step size in programming various subject matters should be 
viewed in this light: the optimal size of a step Is best defined In terms of the 
behavior of the individual student just before taking that step, so that the proba- 
bility of a correct responce has some constant, intermediate value (cf. Gels, 1961). 

The technique illustrated by these experiments in shaping response topog- 
raphy should provide a basis for measuring the Interference produced by the 
first-language repertoire during shaping of second-language fluency. Just as the 
predictions of difficulty In discrimination-learning provided by a contrastive 
analysis may be verified by studies of stimulus generalization, so too these 
predictions for difficulty In response-differentiation may be verified by measure- 
ment of response topography during experiments in shaping. 

An article by R. J. Sweet (1961) describes the application of contrastive 
analysis to the prediction of difficulty in response shaping, with particular 
relevance to sources of interference between English and French repertoires. 
"The control of prommciation, then, involves the sequencing of phonemic 
elements and their combinations so as to minimize the possibility of confusing 
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phonemes and their combinations in the new language with others already 
acquired in the native tongue. Sequencing of these elements depends upon the 
existence of varying degrees ofdifHculty in their pronunication ” (p. 56). The author 
reports that pupils in his classroom research most ohen mispronounce those 
French words which are nearly approximated in English; papier paper, 
brosse and brush, persome and person. 

Several writers, among them Sweet (1962) and Hayes et al. (1962), have 
suggested that the shaping of new response topographies may be accelerated by 
employing those in the first-language repertoire. For example, the student may 
be led to a correct pronunciation of the German tch via the following steps : 
(1) ”fish,” (2) '*fish” said through spread lips; (3) "fish” said through spread 
lips while opening the teeth slowly (after Hayes et al., 1962). The danger of such 
techniques is, of course, that they evoke the very responses in the first language 
which are sources of interference and must be weakened. Here the language pro- 
grammer faces a choice, im guided as yet by research findings, which recurs in 
programming other repertoires as well (see discussion of below). 
By calling into play first-language discriminations and patterns of responding, 
an approximation to the desired terminal behavior is more quickly attained, but it 
may then be more difficult to move precisely onto target. 



Coordinating discrimination and differentiation 

In any formal repertoire, there is a point-to-point correspondence between 
stimulus and response, whether these be spoken or written. The second-lan- 
guage programmer must imdertake, after engineering discrimination and differ- 
entiation separately, to coordinate them. The mastery of International Morse Code 
illustrates the paradigm ; there are 36 basic stimulus patterns each connected 
with a differentiated response pattern. "When one learns to receive code, his 
problem is mainly discriminative, since the written or spoken responses have 
already been well-differentiated ; in sending code, however, the problem is one of 
differentiation, since the discriminative work was done when the student learned 
to read his ABC’s” (Keller and Schoenfeld, 1950, p. 193). Note that conditioning 
a formal repertoire, such as receiving or sending code, establishes a minimi 
fimctional unit of behavior and permits the appropriate extension of this reper- 
toire to new cases. The "minimal textual repertoire” involved in sending Morse 
Code, for example, is extended whenever the telegrapher sends words from 
English text which he has never seen before. 

A consideration of the development of echoic behavior will Illustrate the prob- 
lems of coordinating discrimination and differentiation in any of the four formal 
repertoires. We may restrict our attention to strategies for conditioning a 
minimal echoic repertoire which is later extended to new stimuli as the Occasion 
demands. This minimal repertoire is vital to second-language learning for, once 
it is conditioned, the programmer can evoke new responses as an assemblage of 
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small echoic units never before arranged in this order; this behavior may then 
be reinforced. 

When programming echoic behavior in a second-language, certain auxiliary 
behaviors by the student, which are normally taken for granted in other kinds 
of programming, arc not available. In the more common subject matter 
programs, confirmation is contingent upon not only a correct response but also 
upon a correct discrimination by the student; namely, that his written response 
”is the same as” the printed answer. This requirement of a discrimination is 
rarely mentioned and remains unobtrusive until the student erroneously con- 
siders equivalent such response-confirmation pairs as, “can not” and “does 
not” (Holland, 1959). Under these circumstances, an incorrect response is 
strengthened to the degree that the confirmation stimulus acts as a reinforcer. 

The requirement of a discrimination for self-reinforcement obtrudes from the 
start, however, in programming second-language acquisition, for these dis- 
criminations are not part of the initial repertoire of the student. For example, 
Pimsleur (1 963) writes : 

“The popular notion is that the student who is able to compare his 
pronunciation with that of a native speaker will acquire nativelike speech. 
Many teachers have already realized that this hope is far too optimistic. It is 
evident that students are rather poor judges of their own pronunciation. They 
are prone to think their pronunciation is “good enough” when actually it is 
not acceptable. They are unable to note which features are relevant and which 
arenot”(p. 199). 

In conditioning echoic behavior, the programmer’s task is further Confounded 
by the fact that the confirmation stimulus and the subject’s response are both 
fleeting and presented via different modalities ; an aural stimulus in the first 
instance, sidetone and bone conduction in the second. Furthermore, psycho- 
physical differences in the perception of external vs. “autophonic (self-gener- 
ated) sounds probably impede the development of accurate echoic behavior (vide 
Lane, 1962b). 

How then shall the student’s echoic behavior be selectively reinforced ? 
Assuming that each student shall not have access to a private tutor or to an 
automatic speech recognizer, there seems to be little choice but to condition the 
prerequisite discriminations in the first place, and arrange for their mamtenance 
during later conditions of self-shaping echoic behavior. There is inadequate 
laboratory evidence, however, to confirm that the relevant discriminations, once 
conditioned, are effective in self-shaping echoic behavior, although the pedagog- 
ical success of programs predicated ori this assumption suggests its validity 
(vide Morton, 1961a, and the following section). 

A series of 1 1 pilot studies and three major experiments by Pimsleur, Mace, 
and Keislar (1961) are among the few that examine the effects of discrimination 
training on response differentiation. The central problem of their research was 
”to determine the value of preliminary discrimination training m increasing the 
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effectiveness of language laboratory practices on the pronunciation of French 
sounds.” They found : "(l) Training in discriminating the French nasal vowel 
phonemes /6/, /a/, /r/, rendered subsequent language laboratory practice 
more effective in producing good pronunciation of these phonemes. (2) Training 
in discriminating between the dipthongized and the undipthongized final /o/ did 
not render language laboratory practice measurably more effective in producing 
good pronunciation of this French phoneme” (p. 25). Note that the first discrimi- 
nation is among phonemes in the target language, whUe the second is between a 
French phoneme and a troublesome English approximate. Pimsleur (1963) attri- 
butes the different outcomes to the greater degree of response differentiation that 
existed in the former case for native speakers of English. 

A dose relation between speech discrimination and differentiation is again 
implied by the outcome of a pi’ogramming experiment in speech correction. 
With a carefully designed and executed program that should serve as a model for 
others, Holland and Matthews (1963) taught /s/ discriminations to children who 
misarticulated /s/. The discriminative response was button-press; correct re- 
sponses simply led to the next item ; incorrect responses caused the tape re- 
corder to rewind and repeat the last item. Phase 1 of their program involved 
discrimination of /s/ in isolation from other isolated speech sounds. The latter 
were sequenced according to difficulty and feded in toward equal Intensity with 
the S^. In Phase 2, the subject was required to discriminate the sound in words. 
Sequencing of difficulty and fading were again employed. For example, words 
with initial /s/, terminal /s/, and medial /s/ were presented in that order. In 
Phase 3, the child was asked to identify the position of /s/ within a word. Phase4 
involved discrimination of correctly articulated from misarticulated /s/ sounds 
within words ; omission, substitution, and distortion comprised the misarticu- 

lations. 

The group of children who worked through this program showed signifi- 
cantly improved /s/ discrimination, sibilant discrimination, and, of particular 
interest here, improved /s/ articulation on a series of tests. 

There are several considerations, however, that strongly question the value of 
discrimination training before response differentiation. The first of these is the 
outcome of an experiment by Lane and Schneider (1963) that measured the 
accuracy of self-shaping echoic responding to Thai tonemes under several 
procedures. These authors report that discrimination training, in which the 
target toneme was contrasted with segments of the same form but different 
durations and pitch slopes, did not lead to a marked improvement in echoic ac- 
curacy. The further introduction of delayed auditory feedback of the subject’s 
response, facilitating comparison of the model and his attempt at imitation, also 
failed to produce an appreciable improvement in the correspondence of stimulus 
and response pitch or duration. The juxtaposition of model and imitation did 
not lead to an improvement in echoic accurracy despite the feet that the subjects 
had previously shown perfect discrimination between tonemes that were more 
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similar than the model and their attempts at imitating it. This high level of dis- 
crimination was reached rapidly during training and probably reflected transfer 
of first-language discriminations, as discussed earlier in this article in the section 
on Discrimination, The findings reported in that section, taken together with these 
data on echoic behavior, indicate that inadequate response-differentiation can per- 
sist despite a very fine-grained discriminative repertoire. 

Research at the Haskins Laboratories on the generalization of synthetic speech 
stimuli, discussed earlier, casts further doubt on the necessity of discrimination 
preceding differentiation in the conditioning of formal repertoires. Indeed, 
inference from these findings suggests that discrimination training ideally 
should follow response differentiation. In a review of research on speech percep- 
tion, Liberman (1957) writes: ’'All of this strongly suggests ... that speech is 
perceived by reference to articulation -that is, that the articulatory movements and 
their sensory effects mediate between the acoustic stimulus and the event we call 
perception” (p. 122), It follows from this motor theory of speech perception that 
two relatively similar external stimuli could be made more discriiiiinable "if we 
could attach to those stimuli two very different mediating responses and hence 
gain the added distinctiveness of their very different proprioceptive returns 

(p. 123). , - , 

As an example of this suggestion we may consider the implications of the 

studies by Liberman et al. (1961b) on the discrimination of /p/ and /b/ in inter- 
vocalic position. An experiment similar to the /do/ - /to/ study described earlier 
was performed with the synthetic speech stimuli, /raebid/ -/raepid/. These 
stimuli varied only in the duration of the silent interval between the two syllables 
in each word, which ranged from 20 to 130 msec. Labelling responses by native 
Americans "partition” the stimulus continuum into two perceptual classes: 
/raebid/ stimuli and /raepid/ stimuli. This outcome is attributed to covert 
mediating responses which provide discrete cues (e.g., voiced-voiceless) for the 
labelling judgments. A modest extension of Liberman’s hypothesis suggests that 
a foreign student who has not learned the differentiated response patterns /b/ — 
/p/ in English should find this auditory discrimination much more difficult than 
do native Americans. Mofeover, if the new responses /b/ and /p/ are differ- 
entiated out of the student’s current vocal repertoire, this should enhance the 
discrimination of /b/ and /p/ when presented to him as auditory patterns, for 
now the student’s responding may be controlled by intervening articulations that 

provide very different proprioceptive cues. 

Further support for the suggestion that vocalization may facilitate the develop- 
ment of speech sound discrimination comes from some observations reported by 
Holland and Matthews in their study of /s/ -discrimination, discussed above. The 
authors actually compared several programs for conditioning this discriminative 
behavior; they note that the one described earlier produced the most spontane- 
ous vocalizing by students working through the program as well as the greatest 
improvement on the /s/ -discrimination tests. They suggest that "these vocaUza- 
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tions might force careful observation of auditory cues, or they might provide 
supplemental kinesthetic stimuli which could be useful in close discriminations. 

It is unfortunate that the pedagogical implications of the motor theory of 
speech perception have not been put to empirical test. The outcome might have 
importance not only for second-language learning but also for an evaluation of 
the theory itself, which presently lacks a firm empirical basis (v/deL&tie, 1964c; 
Cross, Lane and Sheppard, 1964). 



Ecboic Behavior 

Among the four formal repertoires delineated earlier, echoic behavior, in- 
volving a spoken response to a spoken stimulus, receives the major emphasis in 
modern-language pedagogy. ’’Today we are pretty much in agreement that the 
grammar-and-translation method, patterned largely on the traditional study of La- 
tin, is obsolete at the least” (Mildenber^rer, 1962, p. 168). Instead, the major empha- 
sis is on aural presentation of stimuli and oral response-the audiolingjual method. 
The objectives of the method include thematic repertoires to be discussed later, 
but its modus operandi involves the purely formal components of an echoic reper- 
toire. ’’The justification for this emphasis is found in the observation that a lan- 
guage is first of all a system for social communication ; writing is a secondary 
derivative system for the recording of spoken language . . .” (Carroll, 1962, p. 5). 

The audio-lingual method may be characterized by Brooks’ (1959) well- 
known dicta: ”1. The learner should hear only authentic foreign speech. 2. He 
should hear much more than he speaks. 3. He should speak only on the basis of 
what he has heard. 4. He should read only what he has spoken. 5. He should 
write only what he has read. 6. He should analyze, if he does so at all, only what 
he has heard, spoken, read, written, and learned.” , 

Despite the widespread use of the audio-lingual method and the related 
proliferation of language laboratories (Hayes, 1963), considerable uncertainty 
remains about the value of this approach to second-language learning. Questions 
such as these, posed by K. A. Mueller (1962), are largely unanswered by available 
research findings: Does withholding texts, and the absence, of reading and 
writing, in the early stages of language learning by this method affect perform- 
ance in pronunciation, oral comprehension, reading, writing and syntax at 
various stages in the course?* Does the use of the language laboratory contrib- 
ute to performance on audio-lingual skills and on others, too? What types of 
language laboratory facilities are most valuable (vide Morton, 1961b) in pro- 
ducing second-language fluency? 



* [Editor’s note] The paper of Sawyer et al. ««The utility of translation and 
written texts in the first thirty hours of language study”. IRAL, 1963, 3—4, 157— 
192, addresses itself to this question. 
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Scherer and Wertheimer (1962) sumarize the dispute over the audio-Ungual 
method : 

''Inherent in the assumptions underlying an audio-lingual approach to 
foreign language learning is that students trained only audio-lhigually at the 
beginning will subsequently reach, and perhaps surpass, in reading and 
writing ability, students who have been trained in the more conventional 
manner, while exhibiting a far higher level of achievement in auditory com- 
prehension and speaking; advocates of the traditional multiple approach, 
with its heavy emphasis on grammar and reading, are of a contrary opinion. 
Little evidence based on controlled experimentation exists” (p. 298)- 
These authors have performed a rigorous and comprehensive experiment to 
contrast the efiects of the audio-lingual method, which employs primarily echoic 
behavior, to those of "traditional” methods, which rely more heavily on textual 
behavior. Noteworthy among their criteria were several novel tests of "habituated 
direct association” (roughly, "the ability to think in German”), which are de- 
scribed by Wertheimer and Scherer (1962). To precis their findings: audio- 
lingual students were superior in listening and speaking ability, comparable in 
reading and writing, and inferior in translating when compared to a control 
group taught by traditional methods. The former were also superior in respond- 
ing to spoken German rapidly, appropriately, and in a fashion comparable with 
that of German bilinguals. (Other comparisons of traditional and audio-lingual 
methods are cited by Carroll, 1962.) 

The third tenet of the audio-lingual method-the student should speak only 
on the basis of what he has heard-may be reflected in the decision of many lan- 
guage programmers to condition discrimination before response differentiation. 
The decision cannot be based presently on laboratory research, for the findings, 
discussed in the earlier section on Coordination, are equivocal. Sapon (1961a) 
incorporates the audio-lingual principle in his program in elementary Spanish : 
"In evaluating any program, one must remember that an individual can say only 
what he can hear, and one of the great strengths of this program is its training 
in auditory discrimination” (p. 8). Morton’s (I960) audio-lingual program for 
Spanish also has this approach. His first "hypothesis” and procedure in the pro- 
gram is called "Phonematization” : 

"Essentially, this would hold that the incipient language learner learns first 
to “hear’ and discriminate between all 'significant classes of sounds in the 
new language before a conscious effort is made to reproduce them ; or, 
indeed before any real capability exists for reproducing them. It is an aural 
conditioning necessary to set up the 'phonemic areas’ which will work finally 
in his acoustico-neurological system like a sefies of narrow -band filters, 
passing appropriate soimds, rejecting others automatically . . . ” (p. l4). 

When discrimination learning is accomplished, most second-language pro- 
grams move on to echoic behavior, in the hope that the prerequisite response- 
differentiation will literally take care of itself (through some mechanism of self- 
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shaping). For example, in Morton’s audio-lingual Spanish program the proce- 
dure of "Phonematization” is followed by one called "Sound Reproduction" : 

". . . automatic reproduction of all speech sounds as individual acoustic 
segments is achieved afkr phonematization of these sounds ... By means of the 
230 individual sound reproduction drills, the student was expected to learn 
to render correctly, both in isolation and in combination, all of the sounds 
and sound groups (syllables and utterances) phonematisized earlier "(p. 16). 
Similarly, programs in elementary French by Valdman (1964) and by T. Muel- 
ler (1962) begin with discrimination training, followed by response differen- 
tiation through echoic behavior. In Mueller’s program, each vowel and con- 
sonant defines a separate unit in discrimination training. Each unit "teaches the 
student to discriminate against the S<^ sounds and, after that, against the various 
intonational features such as: pitch, stress, rhythmn, and syllabification" 1). 
Selfshaping of echoic behavior follows this discrimination training. 

Lermontoff (1961) advocates the early introduction of textual material in pro- 
gramming echoic behavior. He argues that "some subjects find it easier to dis- 
criminate two sounds after they have read words in which they occur.” Conse- 
quently, this author’s program in elementary French has the following features : 
‘We first present a new word aurally; and next we have the subject listen 
to it again and repeat it ; then we have him listen to it and repeat it while he is 
at the same time presented with its written form ; and finally we have him read 
the word aloud and then let him hear the correct pronunciation on the tape” 
(p-75). 

A French program by Moraud (I 96 I) also integrates echoic and textual be- 
havior. The conditioning procedure has six steps. 

"1. [The students] hear a sentence . . .and read the text presented . . . unless 
the text has been faded out completely. 2. They repeat the sentence into the 
microphone or give answer into microphone. 3. They write answer on answer 
sheet imless instructions call exclusively for an oral response. 4. They listen 
to correct oral response and read correct written response. 5. They make 
appropriate connections. 6. Thqr move to the next frame" (p. 24). 

Rocklyn (1961) and his collaborators have prepared programs in several lan- 
guages to condition echoic behaviors concurrent with a limited thematic reper- 
toire. Their effort is of particular interest because they have applied linguistic 
and behavioral analysis to the choice of terminal behaviors as well as to the 
design of a program. Usually, the second-language programmer must accept the 
target language as given. However, programming should be viewed as one 
technique among many in educational technology and, whenever it is possible to 
do so, the entire learning task should come within the purview of the behavioral 
engineer. A report by Rocklyn and Moren (1962) describes programming tech- 
nique of this group as applied to the acquisition of a limited tactical language in 
Russian. The language was designed to include I 6 commands (e.g., “hands 
up"), 10 question frames ("how many”), 100 inserts ("tanks, guns"), and 
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100 answers (yes, no, numbers, etc.). The conditioning paradigm included a 
recorded Russian or English stimulus, a student response In either Russian or 
English, depending on the stage In the program, and a recorded correct utter* 

ance as confirmation. 

Although the acquisition of echoic behavior overlaps with that of thematic 
repertoires In most second-language programs, in a few die two repertoires are 
strlcdy sequenced. For example, Morton (I960) writes, concerning his Sp^h 
progL, . .automatic reproduction of aU speech sounds . . Is aAleved. . . fe/tvr 
L consistent use of the sounds In meaningful utteiances^ (p^ 16) 

(1962) reports on his program In elementary French : 'We begm with a sound 
discrimination and production sequence followed by grammatlcd transforma- 
tions deaUng with features comprised exduslvely of sounds that the student has 

been taught to discriminate and differentiate. 

To summarize: Echoic behavior receives the greatest emphasis among t e 
formal repertoires, partly because of the widespread acceptana ofan audio- 

lingual approach to language pedagogy In general. Most often, the developme 

of echoic behavior skips from discrimination training to Imitation with the 
intervening steps - response differentiation and coordination - largely omi^d 
In so doing, the programmer capitaUzes initially on the students different! te 
first-language repertoire, leaving to the self-shaping process the resolution 
phoneUc differences between the two languages. Echoic behavior is taught be- 
fore thematic repertoires in some second-language programs, and concurrent 

with them in others. . 

Several specialized devices have been designed to implement programmed 
acquisition of echoic behavior. GUpin (1961) has described a system composed 
of two tape recorders (master and student) and relay circuitry which is operated 

by the student with a control panel. Fifteen buttons permit control of the mo 
recorders in a variety of ways that provide an extremely flexible arrangement of 
stimulus and response recording and presentation. Carroll (1^63a) has designed 
and constructed an audio-visual device, shown in Fig. 10 The device has three 
operational modes. In the "familiarization mode," the student is first presented 
wk instructions, new material and the like; then he is given some task to per- 
form, such as answering a question; then he finds out whether the response e 
made was correct or not. There is provision for vocal, written, and mifftiple- 
choice (button-press) responding. When the student meets a criterion perform- 
ance in this mode he proceeds to the 'learning mode” which omits instructions 

and provides only questions and confirmation. After criterion is reached m t i 

mode, the student goes on to the "test mode” where only questions are pre- 

sented. . 

Lane and Buiten (1964) have implemented a computer-based system to permit 

programming and selective reinforcement ofechoic behavior restricted to the pros- 
odic features of speech. This system extracts the intonation, tempo, and relative 
amplitude parameters of a recorded stimulus pattern and of the subject s echoic 
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Figure 10. An audio-visual device for self-instruction in language learning. A sample 
film loop is resting above the projection screen, a sample magnetic tape cartridge 
along side the screen. To the left of the screen are a loudspeaker and a box con- 
taining relay circuitry. In the foreground is the control panel operated by the 
student and a write-in paper tape. (From Carroll, 1963 a.) 

response, compares one or more parameters of the stimulus and response, and 
presents either an analog or discrete representation of the parameter mismatch 
to the subject. Depending on the magnitude of the error voltage and a pro- 
grammable criterion, the subject is automatically presented either with a repeat 
of the last pattern or with the next pattern in the program. 

Porter has surveyed the use of audio-visual aids (1958) and of other instruc- 
tional devices (I960) in foreign language teaching with emphasis on the imple- 
mentation of programmed instruction. Carroll (1963) provides a list of teaching 
machines designed for second-language programs. 

Transcription 

When both the stimulus and response are written, all the properties of echoic 
behavior apply in the conditioning and maintenance of transcription. If the 
second-language orthography is not common to English, the development of a 
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purely formal repertoire will require both discrimination training and response 
differentiation, Such problems as the minimal unit, extension to new stimuli, 
coordination and automatic self-reinforcement, which arose in our discussion 
of echoic behavior, are pertinent to transcription and their solutions are an- 
alogous. For example, because the stimulus and the response-product are com- 
mensurate in transcription, as they are in echoic behavior, a possible pro- 
gramming strategy is to condition orthographic discriminations and responses 
Initially, and then trust that the student will discriminate the accuracy of his 
transcriptions, automatically shaping his own behavior to minimizethc mismatch 
bet^'een his response and the model pattern, If the second-language orthography 
is largely the same as in English, the required stimulus discriminations and 
response differentiation have already been acquired. This is the case for most 
second language programs. Noteworthy exceptions are the programs that con- 
dition transcription in Russian (Saltzman, 1963) and Hebrew (Hammond, 1962). 

Ttxtml Behavior 

Textual behavior is vocal responding under the control of a non-auditory 
verbal stimulus. The emphasis here is on the formal properties of such be- 
haviors as reading aloud from a second-language text in that language. Formal 
and thematic repertoires are combined when a student reads a second-language 
text while translating into his native language. Many of the problems in pro- 
gramming the acquisition of textual behavior in a second-language are similar 
to those associated with echoic behavior and transcription discussed earlier. 
Discriminations within the second-language orthography must be conditioned 
and vocal responses must, of course, be shaped out of the student s initial 
repertoire. If the target language employs fundamentally the same orthography 
as in English, these discriminations require only minimal attention from the 
programmer. Furthermore, if textual behavior is programmed following echoic 
behavior, then the requisite response differentiation is available without further 
conditioning. It remains only to set up correspondences between discriminative 
stimuli, usually printed text, and differentiated vocal responses. 

This strategy in programming corresponds to the fourth tenet of the audio- 
lingual method - ie student should read only what he has spoken - and it has 
a counterpart in the classroom practice of teaching audio-lingual skills before 
reading. As Scherer and Wertheimer (1962), K. A. Mueller (1962), and others 
have pointed Out, there is little research evidence in support of this practice. 
Indeed, when audio-lingual methods have been compared with sight methods in 
producing speed and retention in reading, all four possible outcomes have been 
reported; (1) ”Oral-aural and reading proficiency constitute separate, indepen- 
dent skills which do not develop one from the other” (Agard and Dunkel, 1948, 
p. 291); (2) "aural learning facilitates visual relearning, this facilitation is greater 
than the facilitation of aural relearning by visual learning,” (Pimsleur & Bon- 
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kowski, 1961, p. 106); ( 3 ) "subjects who learned visually and relearned aurally 
achieved superior performances in comparison with performances ofsubjccts who 
learned aurally and relearned visually," (Asher, 1962, p. 38); (4) "students taught 
by the audio-lingual method . . . were almost on the same level with students 
taught by the traditional method in new-type reading and writing tests " (Scherer 
& Wertheimer, 1962, p. 302). 

The greatest difficulty in programming textual behavior arises from a differ- 
ence between this repertoire and transcription or echoic behavior. The latter 
repertoires have in common that the response-product and the stimulus occur in 
the same modality, visual in the first case, auditory in the second. Hence, it is 
possible to discriminate an improper response by direct comparison with the 
stimulus. On the other hand, dictation and textual behavior have in common 
that the stimulus and the response product are dissimilar — they impinge on 
different modalities. Thus, penmanship can be learned by transcription but not 
by dictation alone, and pronunciation can be learned from echoic behavior but 
not solely from textual behavior. Although there is a point-to-point correspond- 
ence between stimulus and response in textual behavior, there is no formal 
similarity between the two which, coupled with speech discriminations, could 
maintain response differentiation. Skinner (1957) draws the contrast clearly: 

"In echoic behavior, the correspondence upon which reinforcement is 
based may serve as an automatic conditioned reinforcer. The speaker who is 
also an accomplished listener Icnows when he has correctly echoed a re- 
sponse and is reinforced thereby. Such reinforcement brings the form of the 
response closer and closer to the form of the stimulus, the limit being the 
most precise correspondence possible either with respect to the vocal capacity 
of the speaker or his capacity to judge similarity . . . The automatic reinforce- 
ment of reading an 'interesting text, however, has merely the effect of 
increasing the probability of occurrence of such behavior; it does not dif- 
ferentially reinforce correct forms at the phonetic level "(p. 68). 

Although tlie speaker who is reading text is not able to assess the accuraqr of 
his pronunciation by direct comparison with a model, he is, nonetheless, able to 
listen to his own speech and this probably has some editing effect on gross 
mispronunciation. It would be interesting to determine whether the maintenance 
of response differentiation in textual behavior would be impaired by removing 
the auditory feedback to the speaker, as through masking of sidetone.* The 
difficulty of maintaining differentiation in textual behavior need not be a problem 
for the second-language programmer who desires only to condition "reading 
a foreign text for understanding." The widespread practice of conditioning 
students to respond aloud to text in a second language with accurate pronuncia- 



* [Editor’s note] Sidetone here refers to the spoken sound returning to the 
speaker’s ears. It can be masked by applying a high level of random, ‘white" noise 
through earphones to the speaker’s ears. 
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tion, or with the English approximations that the text evokes through gener- 
alization with English ortlxography, seems most inefficient when only translation 
of text is the goal. Most efficient would be a procedure which brought English 
vocal responses directly under intraverbal control by the text (see below); 
no responses in the second language need intervene covertly. A formal repertoire 

is, of course, sacrificed by this procedure. , u u , i 

iUthough the acqxiisition of discriminative control in textual behavior is 

expedited when the student’s first and second languages have largely the same 
orthography, the maintenance of the differentiative component of textual be- 
havior is hampered by the same tokens. Sapon (1952) advocates the elimination 
of orthography in the early stages of language learning for this reason. He cites 
as an example the difficulty of teaching an English student learning Spanish to 
forsake a lateral continuant in response to the textual stimulus (the product 
of some years of conditioning) and to emit instead an alveolar vibrant. On the 
other hand, Lermontoff (1961) was quoted earlier as favoring the introduction 
of textual stimuli during the conditioning of echoic behavior. The question, 
unresolved by research, is; does a common orthography in the two languages 
facilitate the acquisition of textual behavior, by rapidly yielding an approximation 
to the desired response, more than it impedes this acquisition, by interfering 
with accurate pronunciation through the evocation of competing responses in 



the native language. 

Sweet (1962) disowns the problem in his Latin program, where response 
differentiation is of little concern. Programs for languages whose orthography 
is not common to English, as is the case with the CyrUlic, Hebrew, and Arabic 
alphabets and Chinese, Japanese, and Korean characters, need not concern 
themselves with this problem but face another; discriminations among the 
orthographic symbols must be conditioned. (Saltzman, 1963; Hammond, 1962, 
Carroll, 1963a). 



Dictation 

Dictation in a second-language is a formal repertoire that requires the condi- 
tioning of speech discriminations as in echoic behavior and, less often, response 
differentiation as in some cases of transcriptive behavior. The unit of the minimal 
repertoire may be orthographic, stenographic, phonetic, etc. The lack of formal 
similarity between stimulus and response is the source of several of the problems 

encountered in our discussion of textual behavior. 

Among the programs that condition dictation, those by Morton (I960) and 
Harms (1962) bear special mention. Morton conditions dictation as a part of 
discrimination training; the responses are arbitrary orthographic symbols, 
called grammalogs; they are transitional behaviors, eventually replaced by 
differenUated vocal responding during the conditioning of echoic behavior. 
Harms has developed a program to take a student from no knowledge of 
phonetic notation to a level of competence whereby he is able to give the phonetic 
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notation at 95 percent accuracy for words selected at random from the Kenyon- 
Knott dictionary. The program proceeds from dictation of simple sounds 
through dipthongs and affricates, voiced-voiceless oppositions, stop-nasal op- 
posItIons> vowels In CVC frames, consonants with common places of articula- 
tion, semivowels, voiced and voiceless consonants, stress, and randomly selected 
units. The procedure Is as follows : the student hears the word on tape, consults 
a corresponding card for prompting, writes the phonetic notation for the entire 
word, checks his response against confirmation on the back of the card, and 
repeats the sequence. Harms presents evaluation data for native and foreignborn 
students who worked through the program. 



THEMATIC REPERTOIRES 

Purely formal repertoires are of little functional value in their own right either 
for the speaker (or writer) or his audience. ♦) By virtue of the point-to-point 
correspondence between stimulus and response that characterizes these reper- 
toires, the behavior Is highly predictable and. In that sense, conveys little in- 
formation. It is only when formal and thematic sources of strength combine in 
determining a response that we say It Is meaningful. Because It has the proper 
form the response Is, first of all, "Intelligible”; that Is, It has a form appropriate 
to the discriminative training of the audience. Because the response Is also under 
the control of environmental conditions, or operations on the speaker, or his 
own prior veral behavior, or that of other people, or several of these acting con- 
currently, It "tells the audience about” these controlling variables and is likely to 
be reinforced. 

In formal repertoires there Is a point-to-point correspondence betweeti 
stimulus and response — within one dimensional system for echoic and trans- 
crlptlve behaviors, across two such systems for textual behavior and for dictation. 
In thematic repertoires, the response shows no such correspondence to the con- 
trolling variables. The term thematic repertoires will be used broadly here to 
encompass several functional classes of verbal behavior Including intmverhal re- 
sponses, which are under the control of prior verbal behavior, tacts, which are 
under the control of nonverbal environmental stimuli, and mands, which are 



♦) Apologies to my secretary. 

^ Additional contrasts, cited earlier, are the minimal units and their extension 
to new stimuli that characterize the formal but not the thematic repertoires. We 
may now qualify this distinction and note that thematic repertoires partake of both 
properties to a limited degree. Bound morphemes approximate minimal 

thematic units. Extension to new stimuli is feasible for sets such ass concur, recur, 
incur, etc. Larger thematic units may also be extended ; the student who knows the 
meaning of "elephant” has some notion, however crude, of the meaning of 
"elephantiasis,” and so forth. 
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under the control of characteristic reinforcing consequences (vide Skinner, 

1957). , , 

Although it is useful to distinguish the controlling relations involved in intra- 
verbals, tacts, am! mands, it is important to note that most verbal responses are 
multiply-determined by several sets of variables acting in concert. For example, 
the response "fire” may be a tact under the control of a conflagration in one s 
apartment, or it may be a mand for a characteristic reinforcer ("somebody sound 
the alarm ! ”), but it is probably both. It should also be noted that the same 
'*word** may appear in one or more functional classes (in addition to a mand or 
a tact, "fire" could be an intraverbal response to "Ready, aim, . . 



Intraverbal Respmes 

Intraverbal relations within one language include response patterns variously 

called syntactic frames or sequences, grammatical structures, redundant strings, 

contextual constraints, etc. Skinner (1957) treats these under the special heading 
"autoclitics” hi. a fimctional analysis of verbal behavior. Grammatical models, 

among them Markovian, immediate constltuentand transformational, describe this 

patterning by difierent analytical techniques. Although these models are of interest 
to the second-language programmer, especially insofar as they describe the termi- 
nal repertoire that the program is designed to produce, a functional analysis of 
intraverbal chains is of pre-eminent importance since the programmer’s task is 
primarily manipulative. 

Unfortunately, there is a great dearth of laboratory research on the analysis 
and control of intraverbal chaining. Classic studies by Miller and Selfridge 
(1953) and Miller (1958) describe the potent effects of patterning in recall; 
recent psycholinguistlc studies by Berko (1958), Brown and Berko (I960) and 
Brown and Fraser (1962) describe this patterning in the language of children; 
Miller (1962) reports several experiments on the effects of patterning on speech 
perception; techniques for conditioning and maintaining Intraverbal chains, 
however, have not been examined experimentally. Saporta (1963) has undertaken 
an evaluation of three grammatical models in the teaching of foreign languages 
which should prove illuminating in this respect. Sapon’s "reflections on models 
of linguistic structure and language programming” (196lb) reflect, as well, the 
synthesis of analytical and functional approaches to patterning adopted by many 
language programmers : 

"What has generally emerged from my own experience in programming 
Spanish Is the recognition that the straight 'economical' line of language de- 
scription [in linguistics] is neither the shortest nor the most direct route to 
student performance in the language being taught. What does seem to offer 
much promise is a first approach to the language via a series of transforma- 
tions and expansions of basic sentence material. This material can then be 
sequenced to exploit usable existing habits and to avoid conflicting ones ... a 
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kind of contrastive psycholinguistic grammar . , . and finally fixed through the 
use of pattern and substitution drill ”(p. 6). 

In view of the widespread use of drill to condition intraverbal patterns, it is 
unfortunate that this technique has not been put to careful laboratory test. Under 
controlled conditions, it would not be surprising to find sheer repetition mini- 
mally effective. This technique should be contrasted with that of programming, 
in which gradual progression and the development of abstraction through 
multiple examples replaces repetition. Skinner (I960) has contended that no 
one learns by repeating: ”he may learn so little that he needs to repeat and will 
learn more upon successive occasions, but the repetition Itself is not Involved " 
(p. 174). ’'Stamping in” or "fixing” through repetition alonehas not been found 
to be an effective technique for the control of behavior in the laboratory. 

Intraverbal relations beitmti first and second language comprise translation 
for the beginning student. 

"Faced with a passage in the new language, the translator emits appropriate 
intraverbal responses. If these fall into something like a familiar pattern, he 
may then react in any or all of the ways appropriate to a listener . . . Eventually 
the translator improves upon this crude prodedure by developing more 
efficient intraverbal operants, mainly of larger patterns, and by acquiring 
normal listening or reading behavior under the control of the new language 
without the aid of translations ” (Skinner, 1957, p. 77). 

Several language programmers agree that, whereas the evocation of formal 
repertoires in English interferes with the development of these repertoires in the 
second language, the evocation of intraverbal relations between the languages 
hinders not only the maintenance of formal repertoires in die second language 
but also the development of intraverbal chains in that language. Mueller (1961) 
writes ; "Developing automatic control over the sovmd patterns of the language 
is retarded when the student s attention is directed toward meaningful utters, 
ances” (p, 43). A similar statement by Morton (I960) has been quoted earlier. 
(Also see T. Mueller, 1962.) 

On the other hand, some programmers have argued for and implemented the 
early introduction of thematic repertoires such as translation (intraverbals) and 
question-and-answer (mands), on the grounds that motivation is sustained or 
enhanced by this procedure. Presumably, the reinforcing consequences of 
acquiring an intraverbal repertoire such as translation derive initially from the 
fact diat the student may react to his own speech in his native language as a 
listener. 

It remains to be shown by controlled experiments whether the introduction 
of thematic repertoires does in fact impair the formal repertoires established 
earlier; if interference is demonstrated, we need to know the sources and their 
relative importance. The greatest difficulty in this kind of research is accurate 
specification of the dependent variable -- the accuracy of the formal repertoire. 
Subjective techniques of evaluation are undesirable but acoustic specification of 
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the stimulus and the response is at present unwieldy. It may not be premature, 
however, to undertake to assess the effects of introducing thematic repertoires on 
the features of formal repertoires, measured electronically. 

Any of the four formal repertoires may serve as the vehicle for the acquisition 
of thematic repertoires such as intraverbals. Some programs employ » written 
stimulus and written response. These include a program in Hebrew by Ham- 
mond (1962), one in German by Ferster and Sapon (I960), 

Used program to condition Russian vocabulary by Licklider (1962). Valdman 
(1964)*^ Moraud (1961), Harris (1961), and others condition intraverbal re- 
sponses by means of dialogues supplemented by English translation. A Latin 
program by W, E. Sweet (1961) employs a less common procedure; a wri ten 
ItimxAus is connected intraverbaUy to a spoken response. Most of the avatiable 
second-language programs, however, condition spoken 
to spoken English responses. Morton describes the 

SpaLh program as follows; "Practice rather than theory guided us in assum- 
ing that once the structural clues of Spanish had been mastered . . . t e s u en , 
working with the minimal meanings afforded him by these 
ance, could be expected to 'fill in the gaps’ with the help of ^road hints in 

English (i.e., nonliteral translations)” (I960, p. 23). 

Although most language programmers and teachers would agree that literal 
translation is not the solution to the problem of how to introduce an intra^rbal 
repertoire most effectively, the available alternatives also seem unsatisfartory , 
these include non-literal interlinear translations, alternate 

second-language texts, tape-recorded second-language phrases with their English 
"equivalents” in the text, paired associate learning with flash cards or lists, an 
so forth. Morton’s "broad hint” approach, cited above, shows greater promise ; 
it is rdated to a variably-blurred prompting technique, developed by Israel 
(I960) to study vocabulary learning. The auditory analog of Israel s technique 
would be worth exploring; English prompts might be recorded on a t^pe trac 
parallel to one containing foreign-language narrative or questions. The 
could be masked by a noise whose level was under the student’s ® 

prompts could be faded over the course of the recorded program by the e p 

menter, or both. 

The crucial difficulty with all these techniques, however, is the attempt o 
transt a rtponse from one functional class to another. Initially, the student 
says "apple,” for example, as a simple and well-conditioned textual or echoic 
response to the English "apple.” It is desired, however, that this response come 
under the control of (be evoked by) a 

spoken or written "manzana.” That association has no status n the student 
native language. It is not surprising, therefore, that as long as the 
available the English stimuli arrogate control of the English responses. With u 
the translation, however, there is no reason initially for the response apple 
occur in the presence of ''manzana. 



288 IRAL, VOL. II NO. 4, NOVEMBER 1964 



One solution to the apparent paradox Is to evoke the English responses by 
means of collateral stimuli that do not exercise extensive control over these re- 
sponses, and then to fade these collateral sources of strength as the Intraverbal 
linkages between the two languages become established. This formula seems to 
characterize the ingenious technique developed by Shaefer (1961) to condition 
English Intraverbal responses to German text. «) Among the collateral sources of 
strength for a response to English text, there are, in addition to thematic 
prompts. Intraverbal prompts provided by the syntactic structure and by com- 
mon phrases, as suggested earlier. These collateral sources of strength are nicely 
Illustrated by the procedure for generating order-approximations to English 
with successive subjects, employed by Miller & Selfridge (1953). The redimdancy 
of the text Is one way of expressing the degree of control exerted over respond- 
ing by collateral sources of strength. Consequently, when Schaefer replaces hlgh- 
redundancy words In the English text with their German counterparts, as In 
"But why will you say that ich am mad?,” the correct Intraverbal Is emitted and 
It Is emitted In the presence of the German textual stimuli. It remains to fade 
these collateral sources of strength by replacing both more words and words of 
lower redundancy. For example, the above excerpt Is soon followed by "Ich 
heard all things ...’’where "I ” Is less determined by context. In six pages the 
text works up to "Es war laut, aber es grew lauter, Ich say, lauter every 
moment! ” 

The auditory analog of this procedure for conditioning Intraverbal responses 
would be wordi trying and might prove superior on at least two counts. First, 
Schaefer’s procedure evokes English pronunciations of the German words, be- 
cause of the common orthography employed and because German words are 
Interspersed at varying Intervals among the English words In the text. If echoic 
rather than textual behavior were employed, there would be less tendency for 
English pronunciation of the German words to occur and, because the stimulus 
and response-product In echoic behavior are formally similar. It would be possi- 
ble to discriminate the improper pronunciations. This Is not possible In textual 
behavior, as emphasized earlier. The second potential advantage of an auditory 
adaptation of Schaefer’s technique Is the greater number of collateral sources of 
strength that may be manipulated. In addition to the Intraverbal and thematic 
cues available in text, there Is a multiplicity of acoustic cues. Including stress, 
intonation and tempo, which may be used as prompts and vanished as necessary. 



Tacts 

The tact Is a class of verbal operant characterized by a three-term relation : 
nonverbal discriminative stimulus, verbal response, generalized reinforcement. 



®) The technique has been used, perhaps independently, by VanRiper and Smith 
(1962) in conditioning a textual repertoire: reading phonetic script. 
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"The three-term contingency in this type of oper/mt is exemplified when, in 
the presence of a doll a child achieves some sort of generalized reinforcement by 
saying doll} or when a teleost fish, or picture thereof, is the occasion upon which 
a student of zoology is reinforced when he says teleost fish'' (Skinner, 1957)- 
Tacting comprises a large part of the thematic repertoire in first-language learn- 
ing and a minute part in second-language learning ; in the latter case, intraverbal 
responses "carry the thematic load ” (vide Brethower, 1961). Instead of condi- 
tioning the response "manzana” with some generalized reinforcer in the pre- 
sence of an apple or a picture thereof, the response is conditioned as an intra- 
verbal to textual or auditory stimuli, such as: "Say 'apple’ in Spanish,” or "Eva 
comio ii»a manzana envenenada." Once again, the means by which a thematic 
repertoire is taught in second-language learning is to establish one sort of func- 
tional control and hope for transfer to another. Thus, when the student eventu- 
ally confronts an apple and it is appropriate to say "manzana,” we do not expect 
him to be speechless in the face of this novel situation ; we expect manzana-the- 
intraverbal to become manzana-the-tact. The transfer of functional control pre- 
sumably occurs through mediated generalization; that is, at the first confronta- 
tion the tact "apple” is emitted covertly, and "manzana” is uttered aloud as an 
Intraverbal to "apple.” If this leads to some sort of reinforcement on a number 
of occasions, "manzana” will acquire th'^ functional properties of a tact. 

The mediating responses in the student’s native language, required by this 
approach to the conditioning of tacts (i.e., transfer from intraverbal control), 
probably impair the acquisition and maintenance of second-language fluency. 
Carroll (1962) concludes in a survey of research that "foreign words are best 
learned (and probably better retained) when presented in association with the 
objects, actions, qualities, and conditibns which are their referents.” Several 
programs employ pictorial material to this end (e.g., Marty, 1962); much 
greater versatility is provided by educational television (Barcus et al., 1961) and 
specialized audio-visual devices (Carroll, 1963a; Porter, 1958). 

The direct approach to conditioning second-language tacts, however, also 
faces several problems. First, it is difficult to maintain these tacts outside the 
classroom, where the student responds to his environment in his native lan- 
guage. Second, the nonverbal controlling stimulus may evoke English responses 
that will interfere with both the formal and thematic properies of the second- 
language tact. ^ 

The nature of thematic interference between first- and second-language tacts 
is well-revealed in an experiment by Lenneberg (1957) on learning color names 
in six different experimental 'languages.” The languages consisted of four 
color words and the subject’s task was to discover the "meaning’’ of the words 
by observing their use by the experimenter. The nonsense words of the first 
language were distributed over the Munsell color series exactly as the English 
words : brown, green, blue, and pink. The other five languages had words 
whose frequency distributions (generalization gradients) represented systematic 
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distorUons from the previously established English distributions. There were 
two types of distortions : of the slope of the gradients (increasing or decreasing 
the determinacy of the color names), and of the location on the physical wn- 
tinuum (making colors which in English have no specific names a perfert 
example of a color category in the nonsense language). Lenneberg found that il 
the tact generalization gradients (' 'reference relaUonships”) of English were 
undistorted in the second language, the color words in that language were 
learned most easily; if only the locations of the gradients on the stimulus con- 
tinuum were distorted, a small impairment in learning was observed. Learning 
the color names was most retarded when the shapes of the English color 
gradients were distorted in the second language to yield gradually rising slopes, 
that is, less well-defined boundaries between stimulus classes. 

Mcmds 

A mand is a verbal operant in which a response of a given form is reinforced 

by a characteristic consequence. The major variables that control a mand are e 

level of deprivation or of aversive stimulation applied to the speaker and his rein- 
forcement history for similar responses. Questions, commands, entreaties, and 
the like are characterized by this kind of functional control {ytdi Skmner, 1957). 
Mands are difficult to condition in a self-instruction setting because an active 
listener, required to present appropriate reinforcement, is not available. It is 
imwieldy, if not impossible, to arrange characteristic reinforcing consequences, 
such as providing the time if the student should inquire, or complying with a 
command such as "stop,” or granting an entreaty, and so forth. As was the case 
with tacts, the functional class of mands is largely neglected in second-language 
programming in the hope that, when deprivation or aversive stimulation 
occasions a mand, the transfer of certain intraverbals will take place. As is the 
case with tacts, this "slight of mand” presumably depends on mediated generali- 
zation, which may be a mixed blessing, facilitating the thematic accuracy of the 
response but degrading its formal properties. Although several second-language 
programs, notably those of LermontoflF (1961), Morton (I960), and Rocklyn 
and Moren (1962), indirectly condition mands by conditioning intraverbals of 
appropriate form (e. g., "ask for an apple in Spanish”), this may not be the only 
way of proceeding. An audio-lingual program could be so carefully sequenced 
that the occurrence of particular mands by the student was predictable and, 
therefore, the characteristic (i^erbal) reinforcers could be prerecorded on the 
master tape. 

TRANSFER WITHIN AND BETWEEN REPERTOIRES 

The concept of transfer has played a large role in this disquisition on pro- 
grammed learning of a second language ; it has turned up as an observation, an 
explanation, and an assumption at many points, so it may be well to summarize 
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the sources of transfer available to, and often relied upon by, the second-language 
programmer. In echoic behavior and dictation, transfer of first-language audi- 
tory discriminations will occur, enhancing the acvquisition of discriminations 
between sound classes but impeding the learning of equivalences (generalization) 
within these classes. The typical effect is over-discrimination and ^e emphasis in 
conditioning must be on the equivalences among discriminably different soimds. 
In textual behavior and transcription, transfer of first-language orthographic 
discriminations will occur when the second language employs an orthography 
that overlaps with that of English. 

In echoic and textual behaviors, transfer of the differentiated vocal repertoire 
of the student’s first language will occur to the degree that the two languages 
share a similar sound system or orthography. This greatly expedites the acquisi- 
tion of a rough approximation to the desired repertoire, but it impedes the 
.development of accurate pronunciation to the degree that the first- and second- 
language vocal repertoires differ. The consequences of transfer are simUar for 
the differentiated manual repertoire involved in dictation and transcription. 

A textual response will transfer to an echoic repertoire if the relevant auditory 
discriminations have been conditioned, and the converse can occur if the neces- 
sary orthographic discriminations have been learned in the first- or second-lan- 
guage. Similarly, transfer may occur between dictation and transcription if toe 
relevant discriminations have been acquired. In complementary fashion, toe 
student with an echoic repertoire should more readily acquire dictation when 
taught how to write the orthography than one who does not possess that reper- 
toire; a similar transfer of discriminations may be expected to occur between 
transcription and textual behavior. These transfer effects are most obvious when toe 
second-language orthography differs from that of the student S native language. 

Within the thematic repertoires, an intraverbal response may transfer to the 
status of a tact in toe second language; this requires non-verbal stimuli that 
evoke tacts in the student’s native language which are linked intraverbaUy to re- 
sponses in the second language. Intraverbal responses may similarly transfer to 
the status of mands in the second language when deprivation or aversive sUmula- 
tion makes a mand likely and first-language responses intervene. 

Transfer also takes place between toe formal and thematic repertoires. A 
spoken response, whose form was conditioned during the acquisition of a 
purely echoic or textual repertoire, can take on toe functional properties of an 
intraverbal through the replacement of one kind of stimulus control (formal) for 
another (thematic). This intraverbal response may then become a tact or a mand, 
in the manner described above. Similarly, written responses, learned as a part of 
toe formal repertoires dictation or transcription, may transfer to the themauc 

repertoires under suitable conditioning procedures. . j . u 

Finally, I should note that the formal and thematic repertoires acquired m toe 
language laboratory and in toe language classroom do transfer, in some meas- 
ure, to the second-language community. 
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SUMMARY TABLE OF SECOND- 
Available and 



Authors Language Behaviors Receiving Major Emphasis 

Formal Repertories Thematic Repertories 

Echoic Textual Transcription Dictation Intraverbal Tacts Mands 



Carroll 


Chinese 


X 


X 


X 


X 


X 


X 


X 


Chou & Peterson Chinese 


X 








X 


X 


X 


Garvey & Clark 


Chinese 


X 








X 




X 


Burroughs 


French 


X 






X 








Mueller 


French 


X 






X 


X 


X 


X 


Hanzelli 


French 


X 


X 


X 


X 


X 


X 


X 


Lermontoff 


French 


X 


X 






X 




X 


Marty 


French 


X 


X 


X 


X 


X 


X 


X 


Moraud 


French 


X 


X 


X 


X 


X 


X 


X 


Ricket & Dubois French 


X 




X 




X 




X 


Valdman 


French 


X 






X 


X 




X 


Eilert 


German 


X 


X 


X 


X ' 


X 


? 


? 


Ferster & Sapon 


German 






X 




X 






Liedke 


German 


X 


X 


X 




X 




X 


Ventola & 
Wilson 


German 






X 




X 






Bloom 8c Smith 


X. brew 




X 


X 




X 






Hammond 


Hebrew 






X 




X 






Sweet 


Latin 






X 


X 


X 




X 


Thilson 


Latin 




X 


X 




X 


X 


X 


Licklider 


Russian 






X 




X 






Myers 


Russian 


X 


X 


X 


X 


X 


X 


X 


Morton, Mayer, 
&Brethower 


Russian 


X 






X 


X 


X 


X 


Rocklyn, Moren 


, Russian 


X 








X 




X 



&^Zinovieflf 



* This summary of available language programs is based on a survey conducted by the 
author in August, 1963. Additional information and listings may be found in the reference: 
Center for Programmed Instruction (1962). 
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LANGUAGE PROGRAMS* 
In Preparation 



Special 

Presentation 

Device 

yea 

yes 

tape recorder 
tape recorder 

yes 

tape recorder 
yea 

yes 

tape recorder 
no 



Approximate 
Hours to 
Completion 


Location 

of 

Research 


Comments and Source 
S « Study discussed here 
E w Evaluation data reported _ 


undetermined 


Harvard Univer. 


Carroll, 1963a S 


200 


Univer, of Michigan 




14-16 


Encyclopedia 
Brltarmlca Films 




250 


Univer. of Michigan 




year course 


Univer. of Wishington 




200 


Center for Programmed ® 

Instruction 


year course 


Flolllns College 


Marty, 1&62 S 


year course 


HaiTiIlton College 


Blyth, 1961 S, 


18-23 


General Program 
Teaching Corporation 


Carroll, 1962 



tape recorder 


year course 


Indiana 


tape recorder 


60-75 


Encyclopedia 
Britannica Films 


no 


48 


Harvard Univer, 


tape recorder 


year course 


Hamilton College 


no 


17-30 


TMI-Groller 


no 


15-25 


TMI-GroHer 


no 


48 


Princeton Univer. 


tape recorder 


two year course 


Univer. of Michigan 


nft 


undetermined 


Center for Pro- 


SA V 


grammed Instruction 


computer based 


undetermined 


Bolt, Beranck, 
& Newman 


yes 

yes 


1/2 year cov.rse 


Earlham College 


275 


Univer. of Michigan 


tape recorder 


140 


George Washington 
Univer. 



Valdman, lp64 S, E 

Carroll, 1962 

Ferater & Sapon, I960 S, E 

Blyth, 1961 S,E 

Carroll, 1962 

Carroll, 1962 

Hammond, 1962 S, B 

Biblical material 

Sweet, 1962 S 

Lickllder, 1962 S 

Smith, 1963 S, E 

Rocklyn, Moren & S 

Zinovleff, 1962 
Limited tactical language 















ERIC 
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Authors 


Language 


Behaviors Receiving Major Emphasis 
Formal Repertories Thematic Repertories 

Echoic Textual Transcription Dictation Intravcrbal Tacts Mands 


Ssitzman 


Russian 


X 


X X X X X 


Wilson & 
Vcntola 


Russian 




X X 


Barcus 


Spanish 




X XX 


Gilbert 


Spanish 




XX X 


Harris 


Spanish 


X 


X X X X X 


Morton, Mayer, 
St Brethower 


Spanish 


X 


X XXX 


Sapon 


Spanish 


X 


X X X XXX 


vuIUvan 


Spanish 


X 


XX X XX? 


Universal Spanish 

Teaching Machines 


X 


XX X 


WEson St 
Vcntola 


Spanish 




X X 


Morton, Mayer, 
Sc Brethower 


Thai 


X 


X XX 


Elks St Garvey 


Vietnamese 


X 


X X 


Details not avaUable for 






Bailey 


Latin 






Newmark 


French 






Unknown 


Spanish 




X X 


Unknown 


French 






Unknown 


Spanish 






Unknown 


German 




X X 


Unknown 


Hebrew 






Unknown 


Russian 




X 


Unknown 


Russian 






Koppitz 


German 




X X 


Allen 


English 







ifi 
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Special 

Presentation 

Device 


Approximate 
Hours to 
Completion 


Location 

of 

Research 


Comments and Source 
S Study discussed here 
E £= Evaluation data reported 


tape recorder 
no 


1/2 year course 
18-22 


Indiana Univer. 
TMI-Grolicr 


Saltzman, 1963 
Carroll, 1962 




no 


20 


Denver Public Schools 


Carroll, 1962 




no 




TOR Labs 


Carroll, 1962 




tape recorder 


260 


Louisiana State Univer. 


Harris, 1961 


S,E 


yes 


223 


Univer. of Michigan 


Morton, I960 


S 


tape recorder 


50-83 


Encyclopedia 
Britannica Films 


Carroll, 1962 


S,E 


tape recorder 


40-45 


Encyclopedia 
Britannica Films 


Carroll, 1962 


S,E 


tape recorder 


24-35 


Universal Electric 






no 


17-30 


TMI-Grolier 


Carroll, 1962 




yes 


200 


Univer. of Michigan 






tape recorder 




George Washington 
Univer. 


Fiks St Garvey, 1963 
Limited tactical language 


S 



no 



no 



year course 



computer based 



Hollins College 

Systems Development 
Corporation 

AVTA Corporation 

American Teaching 
Systems 

American Teaching 
Systems 

AVTA Corporation 
AVTA Corporation 

AVTA Corporation 

International Teaching 
Systems 

IBM 

Thompson Ramo 
Woolridge 



Uttal, 1962 



ERIC 
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